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(57) ABSTRACT 

Systems and methods for estimating the lifetime of an elec- 
trical system in accordance with embodiments of the inven- 
tion are disclosed. One embodiment of the invention includes 
iteratively performing Worst Case Analysis (WCA) on a sys- 
tem design with respect to different system lifetimes using a 
computer to determine the lifetime at which the worst case 
performance of the system indicates the system will pass with 
zero margin or fail within a predetermined maigin for error 
given the environment experienced by the system during its 
lifetime. In addition, performing WCA on a system with 
respect to a specific system lifetime includes identifying sub- 
circuits within the system, performing Extreme Value Analy- 
sis (EVA) with respect to each subcircuit to determine 
whether the subcircuit fails EVA for the specific system life- 
time, when the sub circuit passes EVA, determining that the 
subcircuit does not fail WCA for the specified system life- 
time, when a sub circuit fails EVA performing at least one 
additional WCA process that provides a tighter bound on the 
WCA than EVA to determine whether the subcircuit fails 
WCA for the specified system lifetime, determining that the 
system passes WCA with respect to the specific system life- 
time when all subcircuits pass WCA, and determining that the 
system fails WCA when at least one subcircuit fails WCA. 

20 Claims, 8 Drawing Sheets 
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SYSTEMS AND METHODS FOR CIRCUIT 
LIFETIME EVALUATION 

CROSS-REFERENCE TO RELATED 

APPLICATION 5 

The present invention claims priority under 35 U.S.C. § 1 1 9 
(e) to U.S. Provisional Patent Application No. 61/355,111 
entitled “Circuit Lifetime Evaluation”, filed Jun. 15, 201 0, the 
disclosure of which is incorporated by reference herein in its to 
entirety. 

STATEMENT OF FEDERAL SUPPORT 

The inventions described herein were made in the perfor- 15 
mance of work under a NASA contract, and are subject to the 
provisions of Public Law 96-517 (35 U.S.C. §202) in which 
the Contractor has elected to retain title. 

FIELD OF THE INVENTION 20 

The present invention relates to the evaluation of the life- 
time of electrical systems and more specifically to the evalu- 
ation of the lifetime of electrical systems using worst case 
analysis. 25 

BACKGROUND 

Worst Case Analysis (WCA) is typically performed to 
evaluate whether a circuit continues to function properly 30 
when subjected to part variations due to environmental 
extremes including (but not limited to) radiation, tempera- 
ture, and aging given the possible parameter tolerances asso- 
ciated with the parts in the circuit design. WCA typically 
involves constructing mathematical models to describe the 35 
behavior of the circuit functions and to verify that the circuit 
performs within specification. There are several different 
approaches to WCA, but one convenient approach to per- 
forming WCA is Extreme Value Analysis (EVA). EVA is 
usually the least complicated and most conservative approach 40 
to WCA. As such, it is a good initial approach. If the circuit 
passes, then there is very high confidence in the results and the 
minimum amount of work was required to verify it. If the 
circuit does not pass, then the design or requirements can be 
modified or a less conservative, but more difficult, WCA 45 
approach can be used. 

When performing WCA using the EVA methodology, the 
parameters of the parts within each (sub)circuit which affect 
performance are combined such that each environment that 
drives them to their extrema is simultaneously acting on the 50 
part. For example, in a space mission, if an operational ampli- 
fier’s offset voltage is maximized when temperature is low, 
radiation is high, and at the end of the mission, then that 
combination of conditions (minimum temperature, maxi- 
mum radiation, and end of mission) is assumed in calculating 55 
the maximum offset voltage. Usually, parameter changes are 
multiplied assuming that they are independent influences on 
the parametric behavior. Thus, to determine the maximum 
positive fractional variation for a parameter: 

60 

( 1 +dP)=( 1 +dX) ( 1 +dS) (1 +dT) ( 1 +dE) ( 1 +dR) 

where: 

dP is the total parametric variation; 

dX is the part initial tolerance; 

dS is the variation due to aging and drift; 65 

dT is the variation due to temperature (worst-case direc- 
tion); 
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dE is the variation due to applied voltage and frequency; 
and 

dR is the variation due to radiation degradation. 

If another set of conditions on the aforementioned opera- 
tional amplifier leads to maximum bias current for that opera- 
tional amplifier, then those conditions are assumed in calcu- 
lating the maximum bias current. In general, a Worst Case 
Database (WCDB) can be generated one time for the param- 
eters of the parts to be used on all the subsequent EVAs. 

In many applications, two sets of WCAs are performed, or 
at least considered; one for conditions with the circuit pow- 
ered (i.e., biased) and one for conditions when the circuit is 
unpowered (i.e., unbiased). Since radiation degradation for 
some parts is worse unbiased, that case must be considered. 
Redundancy is of no value, if a circuit will not turn on when 
it is eventually needed. Alternatively, the variations in the 
WCDB may include the worse of biased and unbiased per- 
formance, and the analyst would not have to consider biased/ 
unbiased differences. 

Considering the extreme radiation environment that can be 
experienced in many applications and the additional part 
parameter variations that can result from high radiation, it is 
likely that many circuits or portions of circuits designed for 
such applications will not pass EVA. If the circuit does not 
pass, then the design can be modified or a less conservative, 
but more difficult, WCA approach can be used; for example, 
temperature tracking is often tried as a modification to EVA to 
attempt to “sharpen the pencil” and get a WCA to pass. The 
intent in doing a different approach is to more accurately 
assess the margins in the design even though more work is 
required. WCA should always be a rigorous (i.e., conserva- 
tive) assessment of the circuit’s expected performance; the 
intent should not be to get around the process in order to just 
get the analysis to pass. 

SUMMARY OF THE INVENTION 

Systems and methods for determining the lifetime of cir- 
cuits in accordance with embodiments of the invention are 
disclosed. In many embodiments, Circuit Lifetime Assess- 
ment (CLA) is performed to estimate the lifetime of a system. 
CLA involves iteratively performing WCA until a lifetime is 
identified at which the worst case analysis (WCA) predicts 
the system will just barely fail or will pass with zero margin. 
Due to the conservative nature of Extreme Value Analysis 
(EVA), when circuits fail EVA additional WCA techniques 
can be applied to assess the circuit that eliminate some of the 
conservative assumptions imposed in EVA. These additional 
techniques more accurately determine the margin, or assess 
the risk, in the designs relative to their required applications. 

One embodiment of the invention includes iteratively per- 
forming Worst Case Analysis (WCA) on a system design with 
respect to different system lifetimes using a computer to 
determine the lifetime at which the worst case performance of 
the system indicates the system will pass with zero margin or 
fail within a predetermined margin for error given the envi- 
ronment experienced by the system during its lifetime. In 
addition, performing WCA on a system with respect to a 
specific system lifetime includes identifying subcircuits 
within the system, performing Extreme Value Analysis (EVA) 
with respect to each sub circuit to determine whether the sub- 
circuit fails EVA for the specific system lifetime, when the 
subcircuit passes EVA, determining that the subcircuit does 
not fail WCA for the specified system lifetime, when a sub- 
circuit fails EVA performing at least one additional WCA 
process that provides a tighter bound on the WCA than EVA 
to determine whether the subcircuit fails WCA for the sped- 
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fled system lifetime, determining that the system passes 
WCA with respect to the specific system lifetime when all 
subcircuits pass WCA, and determining that the system fails 
WCA when at least one subcircuit fails WCA. 

In a further embodiment, performing at least one additional 
WCA process that provides a tighter bound on the WCA than 
EVA to determine whether the subcircuit fails WCA for the 
specified system lifetime comprises performing Refined 
Worst Case Analysis (Refined WCA) with respect to the 
subcircuit and the specified system lifetime. 

In another embodiment, performing Refined WCA with 
respect to the system and the specified system lifetime 
involves performing at least one of measuring the actual range 
of part parameter values for at least one lot of parts that are 
included in the system, measuring the values of the actual 
parts used in the system, or analyzing the thermal gradient 
within the system to determine whether the same extreme 
temperature limit should be applied to each part. 

A still further embodiment includes applying root sum 
squares (RSS) to random circuit parameters. 

In still another embodiment, performing at least one addi- 
tional WCA process that provides a tighter bound on the 
WCA than EVA to determine whether the subcircuit fails 
WCA for the specified system lifetime comprises performing 
Monte Carlo Worst Case Analysis (Monte Carlo WCA) with 
respect to the subcircuit and the specified system lifetime. 

In a yet further embodiment, performing Monte Carlo 
WCA with respect to the system and the specified system 
lifetime includes determining a probability density function 
(PDF) for the performance of at least one part within a sub- 
circuit given the environment experienced by the subcircuit 
during its lifetime, determining extreme part parameters for 
the at least one part based upon the PDF for the part, and 
performing WCA of the subcircuit based upon the extreme 
part parameters for at least one of the parts within the subcir- 
cuit. 

In yet another embodiment, the PDF for a part’s perfor- 
mance is generated by selecting random values based upon 
PDFs of environmental parameters at the point in the opera- 
tional life of the circuit for which the reliability estimate is 
desired. 

In a further embodiment again, performing at least one 
additional WCA process that provides a tighter bound on the 
WCA than EVA to determine whether the subcircuit fails 
WCA for the specified system lifetime comprises performing 
Reliability Quantification with respect to the subcircuit and 
the specified system lifetime. 

In another embodiment again, performing Reliability 
Quantification with respect to the system and the specified 
system lifetime includes determining a PDF for subcircuit 
performance by randomly sampling the PDF s of environmen- 
tal parameters at the point in the operational life of the circuit 
for which the reliability estimate is desired and from derived 
PDFs for the part parameters, and determining subcircuit 
performance based upon the PDF for the subcircuit. 

In a further additional embodiment, performing at least one 
additional WCA process that provides a tighter bound on the 
WCA than EVA to determine whether the subcircuit fails 
WCA for the specified system lifetime includes performing 
Refined WCA with respect to the subcircuit and the specified 
system lifetime, when the subcircuit passes Refined WCA, 
determining that the subcircuit does not fail WCA for the 
specified system lifetime, and when a subcircuit fails Refined 
WCA performing at least one additional WCA process that 
provides a tighter bound on the WCA than Refined WCA to 
determine whether the subcircuit fails WCA for the specified 
system lifetime. 
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In another additional embodiment, performing at least one 
additional WCA process that provides a tighter bound on the 
WCA than Refined WCA to determine whether the subcircuit 
fails WCA for the specified system lifetime includes perform- 
5 ing Monte Carlo WCA with respect to the subcircuit and the 
specified system lifetime, when the subcircuit passes Monte 
Carlo WCA, determining that the subcircuit does not fail 
WCA for the specified system lifetime; and when a subcircuit 
fails Monte Carlo WCA performing at least one additional 
to WCA process that provides a tighter bound on the WCA than 
Monte Carlo WCA to determine whether the subcircuit fails 
WCA for the specified system lifetime. 

In a still yet further embodiment, performing at least one 
additional WCA process that provides a tighter bound on the 
15 WCA than Monte Carlo WCA to determine whether the 
subcircuit fails WCA for the specified system lifetime 
includes performing Reliability Quantification with respect 
to the subcircuit and the specified system lifetime, when the 
subcircuit passes Reliability Quantification, determining that 
20 the subcircuit does not fail WCA for the specified system 
lifetime, and when a subcircuit fails Reliability Quantifica- 
tion determining that the subcircuit fails WCA for the speci- 
fied system lifetime. 

In still yet another embodiment, performing WCA on a 
25 system with respect to a specific system lifetime further 
includes obtaining part information with respect of the parts 
within the system and the scenario of the system. 

In a still further embodiment again, the information con- 
cerning the operating scenario of the system includes infor- 
30 mation concerning the environment experienced by the cir- 
cuit during its lifetime. 

In still another embodiment again, WCA considers at least 
one parameter selected from the group consisting of aging, 
radiation, temperature, initial tolerance, bias, and annealing. 
35 A still further additional embodiment also includes identi- 
fying at least one subcircuit that limits the system lifetime. 

In still another additional embodiment, identifying at least 
one subcircuit that limits the circuit lifetime includes select- 
ing each subcircuit and holding the function of the subcircuit 
40 constant while the other subcircuits can vary, iteratively per- 
forming Worst Case Analysis (WCA) with respect to different 
system lifetimes using a computer to determine the lifetime at 
which the worst case performance of the system indicates the 
system will pass with zero margin or fail within a predeter- 
45 mined margin for error given the environment experienced by 
the system during its lifetime, and identifying at least one 
subcircuit that limits the system lifetime based upon the 
increase in system lifetime that occurs when the subcircuit is 
assumed not to fail. 

50 A yet further embodiment again also includes identifying 
at least one part within the subcircuit that limits the subcircuit 
lifetime. 

Yet another embodiment again, also includes identifying at 
least one part parameter with respect to a specific part in the 
55 subcircuit that limits the subcircuit lifetime. 

Another further embodiment includes a computer config- 
ured to iteratively perform Worst Case Analysis (WCA) on a 
system design with respect to different system lifetimes to 
determine the lifetime at which the worst case performance of 
60 the system indicates the system will pass with zero margin or 
fail within a predetermined margin for error given the envi- 
ronment experienced by the system during its lifetime. In 
addition, performing WCA on a system with respect to a 
specific system lifetime includes identifying subcircuits 
65 within the system, performing Extreme Value Analysis (EVA) 
with respect to each subcircuit to determine whether the sub- 
circuit fails EVA for the specific system lifetime, when the 
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subcircuit passes EVA, determining that the subcircuit does 
not fail WCA for the specified system lifetime, when a sub- 
circuit fails EVA performing at least one additional WCA 
process that provides a tighter bound on the WCA than EVA 
to determine whether the subcircuit fails WCA for the speci- 
fied system lifetime, determining that the system passes 
WCA with respect to the specific system lifetime when all 
subcircuits pass WCA, and determining that the system fails 
WCA when at least one subcircuit fails WCA. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a flow chart illustrating a process for performing 
system lifetime evaluation in accordance with an embodi- 
ment of the invention. 

FIG. 2 is a flow chart illustrating a process for performing 
Circuit Lifetime Assessment (CLA) in accordance with an 
embodiment of the invention. 

FIGS. 3A-3C illustrate the results of Influence Ranking 
Analysis performed upon the circuit illustrated in FIG. 3A in 
accordance with an embodiment of the invention. 

FIG. 4 is a chart illustrating a comparison of the Extreme 
Value Analysis, Refined Worst Case Analysis (WCA), Monte 
Carlo WCA, and Reliability Quantification methods that can 
be utilized in WCA processes in accordance with embodi- 
ments of the invention. 

FIGS. 5 A and 5B show a flow chart illustrating a process 
for performing WCA by applying a sequence of WCA tech- 
niques having increasing complexity to circuits that fail less 
WCA assessments in accordance with embodiments of the 
invention. 

DETAILED DESCRIPTION 

Turning now to the drawings, systems and methods for 
estimating the lifetime of an electrical system in accordance 
with embodiments of the invention are illustrated. In many 
embodiments, a circuit lifetime assessment (CLA) is per- 
formed to determine the point at which a circuit has zero 
margin with respect to its requirement (s). The CLA involves 
repeatedly performing Worst Case Analysis (WCA) on a sys- 
tem to determine the lifetime at which (within a margin for 
error) the worst case performance indicates the system will 
just barely fail or pass with zero margin. In several embodi- 
ments, the parts that provide the greatest impact on circuit 
lifetime are also identified. In a number of embodiments, the 
factors or part parameters that create the risk that the part will 
fail and impact system lifetime are also identified. The infor- 
mation concerning the parts that have the greatest influence 
on system lifetime and/or the factors that create the risk the 
part will fail and impact system lifetime can be utilized to 
redesign aspects of the system to improve the estimated life- 
time of the system. 

In many embodiments, the simulations performed during 
CLA simulate variations in part performance due to aging, 
radiation (including ELDRS), temperature, initial tolerance, 
bias, annealing, and any other relevant phenomena. This 
information can be useful in understanding how much margin 
a design has in comparison to the requirements of a specific 
application, how components of each design are limiting its 
life, where trades should be made to improve circuit and 
system life, and how to employ resources (such as shielding) 
most effectively to extend system life. 

In a number of embodiments, a variety of WCA techniques 
are used to simulate circuit performance. In several embodi- 
ments, an assessment of whether a circuit will fail is per- 
formed using multiple techniques having increased complex- 
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ity and lower margins. In this way, a more accurate 
assessment of whether the circuit will fail to meet operational 
requirements during a specified operational lifetime can be 
obtained alleviating the necessity of over engineering the 
5 system in order to meet certain operational objectives. In 
many embodiments, analysis is performed using a combina- 
tion of deterministic and probabilistic WCA approaches. The 
performance of CLA and the WCA techniques that can be 
performed during CLA are discussed further below, 
to System Lifetime Evaluation 

A process for evaluating the lifetime of a system in accor- 
dance with an embodiment of the invention is illustrated in 
FIG. 1. The process 100 involves obtaining part information 
1 02 with respect to each of the parts within the system and the 
15 operating scenario of the system (i.e. the requirements of the 
system for the specific application). The information with 
respect to the parts typically can be any information that can 
be utilized in an WCA process, and the information concern- 
ing the operating scenario typically includes a circuit lifetime, 
20 and a description of the environment experienced by the 
circuit during its lifetime including (but not limited to) radia- 
tion (including ELDRS), temperature, initial tolerance, bias, 
annealing, and any other relevant phenomena. A CLA can 
then be performed (106) on the system to determine the 
25 lifetime at which WCA predicts the system will fail . As part of 
the process, an Influence Ranking Analysis can also be per- 
formed (108) on each of the parts. Performing Influence 
Ranking Analysis involves identifying the parts that have the 
greatest influence over the lifetime of the system. In several 
30 embodiments, the Influence Ranking Analysis can also 
involve identifying (110) the specific factors or part param- 
eters that cause the part to increase the risk of system failure. 
Once the CLA and the Influence Ranking Analysis is com- 
plete, the process outputs (112) the circuit lifetime estimation 
35 and the details of the parts and/or part parameters that influ- 
ence the circuit lifetime. Processes for performing CLA and 
Influence Ranking Analysis in accordance with embodiments 
of the invention are discussed further below. 

Circuit Lifetime Assessment (CLA) 

40 CLA is performed to determine the point at which a circuit 
has zero margin with respect to its operational 
requirement (s). If there are several requirements imposed on 
the circuit, then the driving requirement determines the life of 
the circuit. CLA results can be used to compare circuit life- 
45 times to determine where design changes, requirement 
changes, or other activities may be warranted to extend the 
overall life of the design. CLA can also be repeated varying 
the requirements, shielding, temperature, or operational 
usage to determine their impact on lifetime. 

50 CLA involves repeatedly performing WCA on a system 
with respect to one or more environmental parameters (e.g. 
radiation exposure) to determine the point at which there is 
practically zero margin with respect to worst case perfor- 
mance of the system. As noted above, when performing WCA 
55 using EVA, the large margins built into EVA may be respon- 
sible for circuits or portions of circuits failing EVA. In many 
embodiments, the WCA performed using CLA also utilizes 
additional WCA techniques that provide tighter bounds on 
the WCA when a circuit or subcircuit fails EVA. In this way, 
60 the CLA is able to provide a much tighter bound on the circuit 
lifetime predicted using WCA. Various WCA techniques that 
can be utilized during CLA in accordance with embodiments 
of the invention are discussed further below. 

During CLA, if the result of the initial WCA analysis is that 
65 the requirement is not met, then the system can be simulated 
using a shorter lifetime. If the result is that there is positive 
margin with respect to the requirement, then the system can 
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be simulated using a longer lifetime. Once two bounding 
system lifetimes are set (one at which the system require- 
ments are met and the other at which it fails), then the point 
with zero margin (within some acceptable error) can be honed 
in upon by repeated analyses. As noted above, WCA provides 5 
a lower bound on circuit lifetime and the more precise the 
WCA analysis the closer the system lifetime obtained 
through CLA will be to the true circuit lifetime. 

In many embodiments, the honing in process utilized dur- 
ing CLA is a simple binary search cutting each successive to 
pass -fail interval in half or by interpolating the intermediate 
value based on the prior pass-fail limits and the margin with 
respect to the circuit requirement being assessed at those two 
points. If a circuit has multiple requirements levied against it, 
then the overall lifetime of the circuit would be the least of the 1 5 
lifetimes assessed for the various requirements. 

A process for performing CLA in accordance with an 
embodiment of the invention is illustrated in FIG. 2. The 
process 200 involves setting (202) an initial lifetime (often the 
anticipated minimum system lifetime for a specific applica- 20 
tion) and then performing (204) WCA to determine (206) 
whether the system requirements are met over the lifetime 
under WCA. If the requirements are met, then the system 
lifetime is set (208) as the new lower bound on the system 
lifetime. If the requirements are not met, then the system 25 
lifetime is set (210) as the new upper bound on the system 
lifetime. A new system lifetime can be selected (214) using 
(but not limited to) any of the techniques discussed above, and 
the process of performing (204) WCA repeated until a deter- 
mination (212) is made that the upper and lower bounds on 30 
the system lifetime under WCA are sufficiently close that the 
lower bound constitutes as accurate estimate of how long the 
system will continue to function within specification. At 
which point, the lower bound is returned (216) as the system 
lifetime. Although a specific process is illustrated in FIG. 2, 35 
any of a variety of processes utilizing WCA can be utilized to 
obtain an estimate of system lifetime using CLA in accor- 
dance with embodiments of the invention. 

The process described above for determining the point of 
zero margin is called Circuit Lifetime Assessment (CLA) 40 
because it yields an estimate of how long the system will 
continue to function within specification. It should be noted 
that the CLA estimate does not address life-limiting issues 
outside of the realm of WCA like random failures or failures 
due to single event effects. So, the life estimate from the 45 
analysis may not necessarily be less than the actual life of the 
circuit if other factors not analyzed come into play or if, of 
course, erroneous assumptions are made in the analysis. 

Based on the results of the CLA, circuits within the system 
can be ranked according to their lifetimes, and system level 50 
trades can be made to improve the lifetimes of the limiting 
circuits (possibly to the detriment of the longest lived cir- 
cuits). Examples of trades can include (but are not limited to) 
reducing radiation shielding from long-lived circuits and add- 
ing that shielding to short-lived circuits. Performing Influ- 55 
ence Ranking Analysis to identify circuits and/or parts that 
heavily impact circuit lifetime and the specific characteristics 
of the circuits and/or parts that increase the risk of failure are 
discussed further below. 

Influence Ranking Analysis 60 

The end result of the CLA is an estimate of a minimum 
value for the lifetime of the circuit analyzed. In many embodi- 
ments, a lifetime estimate is obtained for each circuit in an 
assembly and a determination is made concerning which is 
the life limiting circuit of the assembly. In the context of space 65 
missions, if an assembly’s life limit is small relative to other 
assemblies on the spacecraft (and if that circuit is desired or 
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needed for the entire mission), then it is worthwhile further 
investigating, i.e., to perform a sensitivity analysis of, the 
circuit to understand what contributes to its unreliability. 

In several embodiments an influence ranking analysis is 
performed on a circuit by reassessing the lifetime of the 
circuit for each of the parts and/or part parameters in the 
circuit, holding the function of the part and/or the part param- 
eter constant during the evaluation while allowing all the 
other parts to vary. If the circuit lifetime becomes much 
longer, then that part and/or part parameter has a large influ- 
ence on the lifetime. If the circuit lifetime does not change 
significantly, then that part and/or part parameter has little 
influence on the circuit lifetime. When the change in circuit 
lifetime has been calculated for each of the parts and/or 
parameters that influence the circuit lifetime, the resulting 
lifetimes can be compared to determine which parts and/or 
part parameter(s) had the greatest influence on circuit life- 
time. In a number of embodiments, the most influential parts 
are identified and then the part parameters of the most influ- 
ential parts are analyzed to determine the part parameters that 
have the greatest impact on circuit lifetime. 

In order to illustrate the manner in which part parameters 
are analyzed, the life sensitivity of a sample circuit shown in 
FIG. 2 A when various part parameters are held constant is 
illustrated in FIG. 2B. In the chart shown in FIG. 2B, IU5A-3 
is the bias current of the operational amplifier 202 in the 
sample circuit 200 shown in FIG. 2A, Vo If is the operational 
amplifier offset voltage, and Vtp6 is the 2.5 reference voltage 
established by the RH1009. Referring to FIG. 2B, the life of 
the circuit is dominated by the performance of the RH1009 
shunt regulator diode (204), which generates the 2.5V refer- 
ence at test point TP6 (206) and is indicated as Vtp6 (211) in 
the chart. The other parts of the circuit, including resistors 
R24 (208) and R25 (210), had little effect on the circuit 
lifetime. As a result of this information, design changes 
should focus on the 2.5V reference voltage. For example, a 
more accurate part can be used or the circuit could be rede- 
signed to be less sensitive to the failure of the RH1009 regu- 
lator diode (204). 

As noted above, the specific part parameters that lead to the 
risk of failure can be analyzed as part of the system lifetime 
evaluation. The chart shown in FIG. 2C illustrates the analysis 
of the environmental factors that shorten circuit lifetime. The 
analysis is accomplished by repeating the CLA holding each 
of the environmental functions constant. The chart illustrates 
that radiation (i.e. total ionizing dose 212) is by far the domi- 
nant contributor to life degradation. This knowledge can 
assist in the redesign of the circuit to extend the lifetime of the 
circuit. 

Performing WCA 

The accuracy with which CLA can determine circuit life- 
time depends upon the accuracy of the WCA technique used 
to assess a circuit’s performance under a given set of envi- 
ronmental conditions. A variety of WCA analysis techniques 
that can be utilized to assess a circuit’s performance are 
discussed below. As a general rule, the accuracy with which 
an approach bounds the lifetime of the circuit increases with 
the complexity of the approach. Accordingly, in many 
embodiments, a combination of approaches is utilized where 
the complexity of the assessment increases each time a circuit 
or subcircuit fails a less complex WCA assessment technique 
until a final determination is made concerning whether the 
circuit or subcircuit is capable of meeting its operational 
requirements. 

Both deterministic and probabilistic WCA approaches can 
be used to determine the margins and/or risks associated with 
circuit designs meeting their specified requirements. Deter- 



US 8,392,869 B2 


9 

ministic WCA approaches include (but are not limited to) 
EVA and Refined WCA. Refined WCA is a technique that 
eliminates some of the conservatism that is built into the EVA 
process. Additionally, probabilistic WCA techniques can be 
utilized to further reduce the margins utilized in EVA. Such 
probabilistic techniques include (but are not limited to) two 
new techniques that can be referred to as Monte Carlo WCA, 
and Reliability Quantification. For probabilistic techniques, it 
is expected that the assessment needs to be repeated for many 
different points in time to generate an approximate curve of 
reliability versus time. Without probabilistic WCA tech- 
niques, a purely deterministic WCA can lack the ability to 
assess the impact of redundancy (e.g., two redundant circuits 
will be predicted fail at the same time using EVA or refined 
WCA techniques) and reliability margins in problematic risk 
drivers (e.g., circuits whose reliability is difficult to enhance 
because harder parts are unavailable and added shielding is 
not an option) . Although each of the specific WCA techniques 
referenced above are discussed below, any WCA technique 
can be utilized in CLA as appropriate to the requirements of 
a specific application in accordance with an embodiment of 
the invention. 

Extreme Value Analysis (EVA) 

One of the simplest WCA approaches that can be used to 
assess the ability of a circuit to meet its requirements is EVA. 
The EVA process begins by dividing the circuit into manage- 
able subcircuits and assigning derived requirements to their 
functions. Mathematical models of those subcircuits are gen- 
erated as a function of the part parameters that affect its 
performance. The theoretical limits for the part parameters 
are determined at the environmental limits specified for the 
application (e.g. temperature, total dose radiation, and age) 
and the specified limits of initial tolerance. Sensitivity analy- 
sis is applied to the mathematical model(s) of each subcircuit 
being analyzed to determine which set of part parameter 
extremes drives it to its most extreme result with respect to its 
performance limits. Then the models are assessed by apply- 
ing the part performance parameter values in the combina- 
tions determined to produce the most extreme results (e.g., 
maximum or minimum) in the function being analyzed. 
Finally, these results are compared with the specified and 
derived requirements for the subcircuit to assess if the 
requirements are met. The EVA process may result in impos- 
sible conditions being assumed for the circuits and subcir- 
cuits being analyzed (for example, two different part param- 
eters from a single part driving a circuit’s performance to its 
maximum state may result from the part being simulta- 
neously at opposite temperature extremes). 

It should be noted that EVA, as well as derivative methods 
like Refined WCA, assumes that the extrema in circuit per- 
formance occurs at some combination of the extremes of the 
performance of the part parameters. That is not necessarily 
the case, especially when dynamic behaviors are involved. In 
many embodiments, a prerequisite to accepting EVA or 
Refined WCA for a given circuit is to eliminate such possi- 
bilities. 

Refined WCA 

Refined WCA provides a process to, albeit with additional 
work, demonstrate that circuits can perform within require- 
ments given circuit and environmental conditions that would 
otherwise exclude the design by the EVA process. The goal of 
Refined WCA is to provide estimates of circuit performance 
that still bound the actual performance in use but which are 
less conservative than those estimates provided by EVA. 
Refined WCA involves effort to eliminate conservatism in the 
WCA process, but still yields a conservative result. Specifi- 
cally, conservatism is reduced by looking at the actual param- 
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eters and environment anticipated to be experienced by each 
part in the circuit. Examples of ways in which conservatism in 
an EVA analysis can be eliminated are discussed below. 

A reduction in the margins allowed for in EVA can be 
5 achieved by measuring the actual range of part parameter 
values for the lots of parts that are included in the system. This 
can reduce the initial tolerances assumed for the parts being 
used in the E\A. Additionally, the actual part values can be 

measured to reduce the tolerance range to the uncertainty in 

to . 

the measurement. 

Further reductions in conservatism can be utilized by ana- 
lyzing the thermal gradient within a system to determine 
whether the same extreme temperature limit should be 
15 applied to each part. EVA sensitivity analysis is still used to 
determine the relative value of the part parameters; the dif- 
ference in temperature is constrained to the limit of the ther- 
mal gradient. For many parts, the limit of the thermal gradient 
across a circuit board may be less extreme than the tempera- 
20 tures used in EVA. Conservatism in the EVA can also be 
reduced by considering only the system allowable operating 
temperature range at the thermal control surface (plus any 
temperature rise due to power dissipated across the circuit 
board). 

25 A root sum square (RSS) can be applied to models, where 
it is determined that the parameters that are being combined 
are each highly improbable limits of independent random 
variations (biases are separately added in algebraically). In 
theory, parameters combined by RSS should all be from the 
30 same underlying distribution. In many embodiments, RSS 
may not be an acceptable alternative in WCA. It is presumed 
that in almost all cases EVA is performed prior to Refined 
WCA and that the models from that effort have already been 
created. If a circuit fails EVA, then an assessment of the risk 
35 drivers can be made. These risk drivers can then be used to 
determine how best to manage the risk. If the decision is to 
proceed with a Refined WCA, only then should that process 
be applied. If a circuit fails Refined WCA, the risk drivers 
again should be identified, and consideration given to RSS. 
40 The steps, or refinements, outlined above can be applied 
singly (as might happen if the EVA was very close to passing 
the requirements) or all together. If many of the steps are 
applied simultaneously, it seems logical to bundle all of the 
steps that focus on changes to the part parameter inputs. With 
45 the exception of RSS of random circuit parameters, all of the 
refinements above only change the underlying part parameter 
values that are applied to the circuit model. Hence, the easiest 
approach for an analysis where more than minor improve- 
ment over the EVA results are attempted in order to meet 
50 requirements is to make all those changes that impact the part 
parameter values and rerun the circuit model. If the circuit 
still fails, then RSS of random circuit level parameters can be 
applied as a final step. 

Monte Carlo WCA 

55 A Monte Carlo based W CA method has been developed in 

accordance with embodiments of the invention, which takes 
into account the actual distributions of the environmental 
parameters in which the parts and circuit operates. The dis- 
tribution of these values determines part parameter extremes 
60 to be used in the WCA, which in turn will estimate the distri- 
bution of the required circuit performance criteria. In this 
Monte Carlo approach two distributions are generated; one 
based on the part parameters that force the circuit to its mini- 
mum operational limit and one for the maximum limit. As is 
65 discussed further below, circuits that cannot meet their 
requirements using Refined WCA can be subjected to this 
Monte Carlo method. 
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In many embodiments, Monte Carlo WCA employs prob- 
ability density llmctions (PDFs) associated with the thermal 
and radiation environments along with deterministic part 
parameter and circuit information to calculate PDFs for a 
circuit ’ s performance with respect to its requirements . In thi s 5 
case, random values are selected for the environmental 
parameters based on their PDFs at the point in the operational 
life of the circuit for which the reliability estimate is desired. 
The extreme part parameters associated with the selected 
environments are calculated. Then the circuit is assessed for 10 
worst case performance based on that set of part parameters. 
Estimates of the PDFs for the circuit performance can be 
generated by sufficiently large numbers of Monte Carlo simu- 
lations. The area under the tails of the estimated PDF for the 
circuit performance that is outside of its required perfor- 15 
mance is a measure of its unreliability. 

Reliability Quantification 

A Reliability Quantification method has also been devel- 
oped in accordance with embodiments of the invention to 
include the distributions associated with part parameters as 20 
well as with the operating environment. Reliability Quantifi- 
cation is an extension of Monte Carlo WCA by which random 
samples are drawn from the distributions of the environmen- 
tal parameters and then from derived distributions for part 
parameters to generate more realistic distributions for actual 25 
circuit performance. 

Reliability Quantification employs PDFs associated with 
the part parameters to gain an even more accurate PDF of 
circuit performance. For each Monte Carlo simulation, ran- 
dom values are selected for the environmental parameters at 30 
the time of interest. Then, based on those selections, PDFs for 
the part parameters that affect the circuit performance are 
generated, and random selections for the part parameters are 
chosen. The circuit is assessed for its performance for one 
data point in the development of its PDF. The process is 35 
repeated (starting with random values for the environmental 
parameters) a sufficiently large number of times to create the 
PDF for the circuit. Again, the area under the tails of the 
circuit performance PDF that is outside of the expected per- 
formance for the circuit is a measure of its unreliability. Given 40 
good inputs, proper modeling, and sufficient simulation 
samples, Reliability Quantification should result in an accu- 
rate estimate of the circuit reliability. In many embodiments, 
due to the increased complexity of Reliability Quantification, 
it is only used on circuits that fail to meet some specified 45 
reliability criteria using the Monte Carlo WCA method. 

Order of Analysis 

A comparison of the four methods described above is con- 
ceptually illustrated in FIG. 4. The EVA results envelop the 
Refined WCA results . The tails from the distribution from the 50 
Monte Carlo WCA analysis are bounded by the Refined 
WCA, and the minimum and maximum tails from the Monte 
Carlo WCA distributions bound the distribution from the 
Reliability Quantification. Although Reliability Quantifica- 
tion provides the most accurate assessment of a circuit’s 55 
performance, it is also expected to be a very time consuming 
analysis. The intent with these different approaches is to try 
the quickest approach first, i.e., EVA, to screen out circuits 
that are acceptable at that level. Then increasingly more com- 
plex WCA assessments can be made until a determination is 60 
made that the circuit is acceptable or the circuit is determined 
to fail to meet its operational requirements using the most 
accurate technique. 

A process for applying various WCA approaches of 
increasing complexity in accordance with an embodiment of 65 
the invention is illustrated in FIGS. 5 A and 5B. As indicated 
above, the process 500 involves performing (502) EVA first. 
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If a determination (504) is made that the circuit does not pass 
EVA and a design or requirement change is not readily 
accomplished to result in an EVA pass, then Refined WCA is 
performed (506). The results of the Refined WCA provide a 
more accurate assessment of the performance bounds than 
EVA. If that second screen determines (508) that the circuit 
performs acceptably, then the process is complete (520). If the 
circuit still doesn’t pass, then Monte Carlo WCA analysis is 
used (510) to pull the bounds in further. In many embodi- 
ments, predetermined criteria are defined for the Monte Carlo 
distribution to assess whether an acceptably small portion of 
the tails is beyond the circuit requirement. Monte Carlo WCA 
typically takes much more effort than Refined WCA. Finally, 
if Monte Carlo WCA determines (512) that the circuit does 
not meet its requirements, Reliability Quantification can be 
applied (514), expanding upon the work in the Monte Carlo 
WCA, to determine the actual expected performance range. 
Throughout the process, design or requirement changes may 
be implemented to make the design acceptable. In the event 
that a determination (516) is made that the circuit does not 
meet its operational requirements based upon the Reliability 
Quantification, then the circuit is finally determined to fail 
(518) to meet its operational requirements under WCA. 

Although a specific process is illustrated in FIGS. 5 A and 
5B for performing WCA, any of a variety of alternative com- 
binations of WCA analysis techniques can be utilized when 
performing CLA in accordance with embodiments of the 
invention. 

While the above description contains many specific 
embodiments of the invention, these should not be construed 
as limitations on the scope of the invention, but rather as an 
example of one embodiment thereof. Accordingly, the scope 
of the invention should be determined not by the embodi- 
ments illustrated, but by the appended claims and their 
equivalents. 

What is claimed: 

1. A method of system lifetime evaluation, comprising: 

iteratively performing Worst Case Analysis (WCA) on a 

system design with respect to different system lifetimes 
using a computer to determine the lifetime at which the 
worst case performance of the system indicates the sys- 
tem will pass with zero margin or fail within a predeter- 
mined margin for error given the environment experi- 
enced by the system during its lifetime; 

wherein performing WCA on a system with respect to a 
specific system lifetime comprises: 
identifying subcircuits within the system; 
performing Extreme Value Analysis (EVA) with respect 
to each subcircuit to determine whether the subcircuit 
fails EVA for the specific system lifetime; 
when the subcircuit passes EVA, determining that the 
subcircuit does not fail WCA for the specified system 
lifetime; 

when a subcircuit fails EVA performing at least one 
additional WCA process that provides a tighter bound 
on the WCA than EVA to determine whether the sub- 
circuit fails WCA for the specified system lifetime; 
determining that the system passes WCA with respect to 
the specific system lifetime when all subcircuits pass 
WCA; and 

determining that the system fails WCA when at least one 
subcircuit fails WCA. 

2. The method of claim 1, wherein performing at least one 
additional WCA process that provides a tighter bound on the 
WCA than EVA to determine whether the subcircuit fails 
WCA for the specified system lifetime comprises performing 



US 8,392,869 B2 


13 

a Refined Worst Case Analysis (Refined WCA) with respect 
to the subcircuit and the specified system lifetime. 

3. The method of claim 2, wherein performing the Refined 
WCA with respect to the system and the specified system 
lifetime involves performing at least one of measuring the 5 
actual range of part parameter values for at least one lot of 
parts that are included in the system, measuring the values of 
the actual parts used in the system, or analyzing the thermal 
gradient within the system to determine whether the same 
extreme temperature limit should be applied to each part. 10 

4. The method of claim 2, further comprising applying root 
sum squares (RSS) to random circuit parameters. 

5. The method of claim 1, wherein performing at least one 
additional WCA process that provides a tighter bound on the 
WCA than EVA to determine whether the subcircuit fails 15 
WCA for the specified system lifetime comprises performing 
Monte Carlo Worst Case Analysis (Monte Carlo WCA) with 
respect to the subcircuit and the specified system lifetime. 

6. The method of claim 5, wherein performing Monte Carlo 
WCA with respect to the system and the specified system 20 
lifetime comprises: 

determining a probability density function (PDF) for the 
performance of at least one part within a subcircuit given 
the environment experienced by the subcircuit during its 
lifetime; 25 

determining extreme part parameters for the at least one 
part based upon the PDF for the part; and 
performing WCA of the subcircuit based upon the extreme 
part parameters for at least one of the parts within the 
subcircuit. 30 

7. The method of claim 6, wherein the PDF for a part’s 
performance is generated by selecting random values based 
upon PDFs of environmental parameters at the point in the 
operational life of the circuit for which the reliability estimate 

is desired. 35 

8. The method of claim 1, wherein performing at least one 
additional WCA process that provides a tighter bound on the 
WCA than EVA to determine whether the subcircuit fails 
WCA for the specified system lifetime comprises performing 
Reliability Quantification with respect to the subcircuit and 40 
the specified system lifetime. 

9. The method of claim 8, wherein performing Reliability 
Quantification with respect to the system and the specified 
system lifetime comprises: 

determining a PDF for subcircuit performance by ran- 45 
domly sampling the PDFs of environmental parameters 
at the point in the operational life of the circuit for which 
the reliability estimate is desired and from derived PDFs 
for the part parameters; and 

determining subcircuit performance based upon the PDF 50 
for the subcircuit. 

1 0 . The method of claim 1 , wherein performing at least one 

additional WCA process that provides a tighter bound on the 
WCA than EVA to determine whether the subcircuit fails 
WCA for the specified system lifetime comprises: 55 

performing a Refined WCA with respect to the subcircuit 
and the specified system lifetime; 
when the subcircuit passes Refined WCA, determining that 
the subcircuit does not fail WCA for the specified system 
lifetime; and 60 

when a subcircuit fails Refined WCA performing at least 
one additional WCA process that provides a tighter 
bound on the WCA than Refined WCA to determine 
whether the subcircuit fails WCA for the specified sys- 
tem lifetime. 65 

11. The method of claim 10, wherein performing at least 
one additional WCA process that provides a tighter bound on 
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the WCA than the Refined WCA to determine whether the 
subcircuit fails WCA for the specified system lifetime com- 
prises: 

performing Monte Carlo WCA with respect to the subcir- 
cuit and the specified system lifetime; 

when the subcircuit passes Monte Carlo WCA, determin- 
ing that the subcircuit does not fail WCA for the speci- 
fied system lifetime; and 

when a subcircuit fails Monte Carlo WCA performing at 
least one additional WCA process that provides a tighter 
bound on the WCA than Monte Carlo WCA to deter- 
mine whether the subcircuit fails WCA for the specified 
system lifetime. 

12. The method of claim 11, wherein performing at least 
one additional WCA process that provides a tighter bound on 
the WCA than Monte Carlo WCA to determine whether the 
subcircuit fails WCA for the specified system lifetime com- 
prises: 

performing Reliability Quantification with respect to the 
subcircuit and the specified system lifetime; 

when the subcircuit passes Reliability Quantification, 
determining that the subcircuit does not fail WCA for the 
specified system lifetime; and 

when a subcircuit fails Reliability Quantification determin- 
ing that the subcircuit fails WCA for the specified sys- 
tem lifetime. 

13 . The method of claim 1, wherein performing WCA on a 
system with respect to a specific system lifetime further com- 
prises obtaining part information with respect of the parts 
within the system and the scenario of the system. 

14. The method of claim 13, wherein the information con- 
cerning the operating scenario of the system includes infor- 
mation concerning the environment experienced by the cir- 
cuit during its lifetime. 

15. The method of claim 1, wherein WCA considers at least 
one parameter selected from the group consisting of aging, 
radiation, temperature, initial tolerance, bias, and annealing. 

16. The method of claim 1, further comprising identifying 
at least one subcircuit that limits the system lifetime. 

17. The method of claim 16, wherein identifying at least 
one subcircuit that limits the circuit lifetime comprises: 

selecting each subcircuit and holding the function of the 
subcircuit constant while the other subcircuits can vary; 

iteratively performing Worst Case Analysis (WCA) with 
respect to different system lifetimes using a computer to 
determine the lifetime at which the worst case perfor- 
mance of the system indicates the system will pass with 
zero margin or fail within a predetermined margin for 
error given the environment experienced by the system 
during its lifetime; and 

identifying at least one subcircuit that limits the system 
lifetime based upon the increase in system lifetime that 
occurs when the subcircuit is assumed not to fail. 

18. The method of claim 17, further comprising identifying 
at least one part within the subcircuit that limits the subcircuit 
lifetime. 

19. The method of claim 18, further comprising identifying 
at least one part parameter with respect to a specific part in the 
subcircuit that limits the subcircuit lifetime. 

20. A system configured to evaluate the lifetime of a sys- 
tem, comprising: 

a computer configured to iteratively perform Worst Case 
Analysis (WCA) on a system design with respect to 
different system lifetimes to determine the lifetime at 
which the worst case performance of the system indi- 
cates the system will pass with zero margin or fail within 
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a predetermined margin for error given the environment 
experienced by the system during its lifetime; 
wherein performing WCA on a system with respect to a 
specific system lifetime comprises: 

identifying subcircuits within the system; 5 

performing Extreme Value Analysis (EVA) with respect 
to each subcircuit to determine whether the subcircuit 
fails EVA for the specific system lifetime; 
when the subcircuit passes EVA, determining that the 
subcircuit does not fail WCA for the specified system to 
lifetime; 
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when a subcircuit fails EVA performing at least one 
additional WCA process that provides a tighter bound 
on the WCA than EVA to determine whether the sub- 
circuit fails WCA for the specified system lifetime; 

determining that the system passes WCA with respect to 
the specific system lifetime when all subcircuits pass 
WCA; and 

determining that the system fails WCA when at least one 
subcircuit fails WCA. 



